TITLE OF THE INVENTION 

Remote Control System for Controlling Installed Program 



BACKGROUND OF THE INVENTION 
5 Field of the Invention 

The present invention relates to a remote control system, and, more 
specifically, to a remote control system that allows the user to control the 
operation of an installed computer program using a remote controller. 
Description of the Related Art 

10 The operation of conventional AV (Audio Visual) equipment such as a 

TV and a CD player can be controlled using a remote controller. 
Meanwhile, as broad band networks have spread and computers have been 
developed, people can now listen to music or view video images with a 
computer. Therefore, some recent computers have a dedicated remote 

15 controller for a music or video image reproducing program. 

However, the conventional remote controller is dedicated to a 
computer program only. Therefore, the user cannot operate the program 
(such as an operating system and an application program) by using a 
remote controller dedicated to other computer program. 

20 In a computer program with the dedicated remote controller, an 

operation of the remote controller is preset, in other words, the user cannot 
change the setting as desired. Therefore, the user has to operate different 
dedicated remote controllers for a number of different computer programs, 
which is cumbersome. 

25 Recently, TV programs or radio programs have their own web pages 

on the Internet. When the user wants to watch a TV program while 
viewing the web page of the program, the user must operate the TV and the 
browser separately, which is cumbersome as well. 

30 SUMMARY OF THE INVENTION 

It is an object of the invention to provide a remote control system 
that allows the user to control the operation of a computer program using a 
remote controller of any kind. 



- 1 - 



A remote control system according to the invention allows the user to 
operate a computer program using a remote controller. The system 
includes a receiver, a register, and an executer. The receiver receives a 
signal from the remote controller and decodes the signal to a remote code. 
5 The register registers the remote code and a selected operation of the 

computer program installed in a computer in a registration table. The 
operation is corresponding to the remote code. The executer executes the 
operation of the computer program corresponding to the registered remote 
code when the receiver receives the signal for the registered remote code. 

10 In the remote control system according to the invention, a signal 

transmitted from the remote controller is received and decoded to a remote 
code, and the remote code is registered in the registration table in 
association with the operation of the computer program. When a signal for 
the registered remote code is received, the operation of the program 

15 corresponding to the remote code is executed. Therefore, the operation of 
the program can be controlled using for example a remote controller for AV 
equipment. One operation of the program may be registered for one 
remote code, or a plurality of operations of the program may be registered 
for one remote code. 

20 Preferably, the register registers a message corresponding to the 

remote code in the registration table. The remote control system further 
includes a display. The display displays the message corresponding to the 
remote code when the executer executes the operation of the computer 
program. 

25 In this way, the user inputs the operation of the program 

corresponding to the remote code as a message. Therefore, the user can 
confirm on the display which operation is executed upon operation of the 
remote controller. 

Preferably, the register registers continuation information 

30 corresponding to the operation of the computer program in the registration 
table. The continuation information indicates whether or not to continue 
to execute the selected operation of the computer program. When the 
continuation information indicates the continuous execution, while the 
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receiver receives the signal, the executer continues to execute the operation 
of the computer program corresponding to the remote code decoded from the 
received signal. 

In this way, when the volume of music software is raised/lowered for 
5 example, the volume continues to be increased/lowered as long as the user 
presses a corresponding button in the remote controller. 

The foregoing and other objects, features, aspects and advantages of 
the present invention will become more apparent from the following 
detailed description of the present invention when taken in conjunction 
10 with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a functional block diagram of the general configuration of a 
remote control system according to an embodiment of the invention; 
15 Fig. 2 is a flowchart for use in illustration of registration processing 

by the remote control system shown in Fig. 1; 

Fig. 3 is a view of an image displayed at the screen of a display for a 
computer in step S4 in Fig. 2; 

Fig. 4 is a flowchart for use in illustration of the operation in step S6 
20 in Fig. 2; 

Fig. 5 is a view of an image displayed at the screen of the display for 
the computer in step S61 in Fig. 4; 

Fig. 6 is a flowchart for use in illustration of the operation in step 
S62 in detail when presetting operation is selected in step S61 in Fig. 4; 
25 Fig. 7 is a view of an image displayed at the screen of the display for 

the computer in step S621 in Fig. 6; 

Fig. 8 is a view of an image displayed at the screen of the display for 
the computer in step S622 in Fig. 6; 

Fig. 9 is a view of an image displayed at the screen of the display for 
30 the computer in step S64 in Fig. 4; 

Fig. 10 is a flowchart for use in illustration of the operation in step 
S62 in detail when file operation is selected in step S61 in Fig. 4; 

Fig. 11 is a flowchart for use in illustration of the operation in detail 
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in step S62 when shortcut key operation is selected in step S61 in Fig. 4; 
and 

Fig. 12 is a flowchart for use in illustration of remote control 
operation processing in the remote control system shown in Fig. 1. 

5 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Now, an embodiment of the invention will be described in conjunction 
with the accompanying drawings in which the same or corresponding 
portions are denoted by the same reference characters and their 
10 descriptions apply likewise. 

General Configuration of Remote Control System 

Referring to Fig. 1, a remote control system 1 includes a computer 10 
and a receiver 20. The receiver 20 includes a decoder 21 and a sensor 22. 
The sensor 22 generates a remote signal cpV in response to an infrared ray 

15 signal IR transmitted from a remote controller 30. The decoder 21 decodes 
the remote signal cpV to a remote code RC specific to the infrared ray signal 
IR. The remote controller 30 may be any remote controller, for example, 
the remote controller for AV or audio equipment. 

The computer 10 includes a central processing unit (CPU) 11, a 

20 memory 12, a display 13, an input device 14 such as a keyboard and a 

mouse, a hard disk 15, and an interface 16. These are connected with each 
other through a bus 17. The receiver 20 is connected to the interface 16, 
and the decoder 21 transmits the remote code RC to the computer 10. 

The memory 12 or the hard disk 15 stores a registration table. The 

25 originally stored registration table has no content. All the contents shown 
in Table 1 will be registered by the user. 
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Referring to Table 1, the registration table has columns for 
registration IDs, remote codes, operations, and display images on the 
screen. The registration ID column has registration IDs for remote codes 
RC registered in the registration table. Remote codes RC are recorded in 
5 the remote code column. The operation column has the contents of 

operations registered for the remote codes RC. The operation column is 
divided into columns for kinds, file names, operation IDs, and continuation 
information. 

The kind column has the kinds of operations of a computer program 
10 to be controlled by the remote controller 30. When the operation of the 

program desired to be registered in the registration table has already been 
registered in a presetting operation table that will be described, "P" is 
entered in the kind column. The operation is for example the operation 
that has been registered in the presetting table such as the shutting down, 
15 rebooting, and standing by of the OS. 

When the operation of the program to be registered in the 
registration table is to open an associated file or allow the user to select an 
application program for opening the associated file, "F" is entered in the 
kind column. When the operation of the program to be registered in the 
20 registration table is the operation of the activated program, "W" is entered 
in the kind column. The operation is for example the operation of the 
activated music reproducing program such as "reproduction" and 
"stopping." In this case, the registered remote code RC serves as a 
shortcut key. 

25 When "F" is in the kind column, a desired data resource such as a file 

path to a file and an Internet address of a web page is entered in the file 
name column. When, for example, the browser is activated and an 
Internet web page of interest is viewed, the Internet address of the web 
page is entered in the file name column. 

30 When "W" is in the kind column, an identifier to specify the activated 

program to be registered is entered in the file name column. For example, 
when the program activated by the OS is displayed in a window on the 
screen of the display 13, the class name to specify the window of the 
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activated program is entered in the file name column. 

Operation IDs to specify operations to be registered for remote codes 
are entered in the operation ID column. The operation ID varies 
depending on the kinds P, F and W entered in the kind column. The 
5 operation IDs for the kind P are entered in a presetting operation table as 
shown in Table 2. The operation IDs for the kind F are entered in a file 
operation table as shown in Table 3. The operation IDs for the kind W are 
entered in a shortcut key operation table as shown in Table 4. 

10 



Table 2; Presetting Operation Table 



Kind 


Operation ID 


Operation 


P 


1 


Log Off 




2 


Shut Down 




3 


Reboot 




4 


Stand-by 
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Table 3; File Operation Table 


Kind 


Operation ID 


Operation 


F 


1 


Open File 




2 


Select Application Program 




■ ■ ■ 


■ ■ ■ 



15 
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Table 4; Shortcut Key Operation Table 



Kind 


Operation ID 


Key Operation 


W 


1 


"Ctrfkey+"C"key 




2 


"Enter"key 










235 


"A"key 




■ ■ ■ 






577 


"Shift"key+"F1"key 




a a a 


■ ■ ■ 



Table 2 is an example of the presetting operation table. The 
5 presetting operation table indicates operation IDs that can be registered 
when "P" is entered in the kind column, and there are tables as many as 
the programs whose operations have been registered. For example, when 
the operations of both the OS and the browser are registered, there are two 
presetting operation tables. When the operation of the application 

10 program is pre-registered, there is a presetting operation table for the 
application program as well. The presetting operation table for the 
operation of the OS stores operation IDs for various operations by the OS 
such as logging off and shutting down. The operation IDs registered in the 
plurality of presetting operation tables are all different. For example, 

15 when operation IDs in the presetting operation table for the OS are 

designated 1 to 10, operation IDs in the presetting operation table for the 
browser are designated 11 to 20. The operation of the keyboard or mouse 
in the input device 14 may be registered in a presetting operation table. 
The file operation table as shown in Table 3 is a table of operation 

20 IDs that can be registered when "P" is entered in the kind column. In the 
file operation table, 1 is for "open file" (operation ID = 1), and 2 is for "select 
application program" (operation ID = 2). The "open file" refers to the 
operation of activating the application program associated with the file 
based on its extension and opening the file. The "select application 

25 program" refers to the operation of allowing the user to select the 
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application program for opening the file regardless of its extension. 

The shortcut key operation table as shown in Table 4 stores 
operation IDs for operations at the input device 14. When the input device 
14 is a keyboard for example, the operation IDs are registered for key 
5 operations and combinations of key operations. The operation ID for 

operating the key "A" in the keyboard is 235 (operation ID = 235), while the 
operation ID for operating both the control key and the key "C" 
simultaneously is 1 (operation ID = 1). 

The operations and operation IDs to be registered to the presetting 

10 operation table, the file operation table, and the shortcut key operation 
table may be increased/reduced or changed by the user. 

Referring back to the registration table shown in Table 1, the 
continuation information column has continuation information for 
determining whether or not to continue an operation in the operation ID 

15 column when receiving a remote code RC in the remote code column 
(when for example the user continues to press a button in the remote 
controller 30). When "1" is entered in the continuation information column, 
the operation under the operation ID is continued as long as the remote 
code RC is received. When for example the user wants to continuously 

20 increase the sound volume using the music reproduction program, the 
continuation information "1" is entered in the continuation information 
column. When the continuation information "0" is entered, the operation 
under the operation ID is carried out only once while the remote code RC is 
received. 

25 The display image column is used to display a message at the display 

13 when an operation under an operation ID is carried out. The display 
image column includes a display content column and a display column. 
The message to be displayed at the display 13 is entered in the display 
content column. The message is input from the input device 14 by the user. 

30 When for example an infrared ray signal IR whose remote code RC is 

"2D0012" in Table 1 is received, "shutting down" is displayed at the display 
13. The display column is used to determine whether or not to display the 
message. When "1" is entered in the display column, the message is 
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displayed at the display 13. When "0" is in the display column, no 
message is displayed at the display 13. When there is no message in the 
display content column, "0" is entered in the display column. Even though 
there is a message, the user may enter "0" in the display column. As 
described above, the user may input a message. Alternatively, the user or 
computer 10 may select a pre -registered message. 

A remote control program is installed in the computer 10, so that the 
remote control system 1 carries out remote control setting processing and 
remote control operation processing. 

Remote Control Setting Processing 

Referring to Fig. 2, the receiver 20 receives an infrared ray signal IR 
from the remote controller 30 at the sensor 22 (Si). The remote controller 
30 may be for TV or audio equipment. The sensor 22 converts the infrared 
ray signal IR into a remote signal (pV and transmits the signal cpV to the 
decoder 21. The decoder 21 decodes the received remote signal (pV into a 
remote code RC (S2). The remote code RC corresponding to the infrared 
ray signal IR is transmitted to the computer 10 through the interface 16. 

The computer 10 determines whether or not the remote code RC has 
already been registered (S3). More specifically, the computer 10 refers to 
the registration table stored in the memory 12 or the hard disk 15 in order 
to determine whether or not the remote code RC transmitted from the 
decoder 21 has already been registered in the registration table. If the 
code has not yet been registered, the computer 10 asks the user whether or 
not to start registration of operation for the remote code RC (S5). If the 
user selects the starting of the registration, the computer 10 starts 
processing of the registration (S6). 

Meanwhile, based on the result of determination in step S3, if the 
remote code RC has already been registered in the registration table, the 
computer 10 asks the user whether or not to register another operation for 
the remote code RC (S4). Specifically, the computer 10 displays the screen 
image as shown in Fig. 3 at the display 13, and asks the user whether or 
not to register multiple operations for the single remote code RC. When 
the user does not desire the registration of multiple operations and selects 
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"NO" in the screen image in Fig. 3, the remote control system 1 returns to 
step SI, and restarts the remote control setting processing from the 
beginning. 

Meanwhile, if the user selects "YES" in step S4 in the screen image 
5 in Fig. 3, the computer 10 asks the user whether or not to start the 
registration of operation(S5). If the user selects the starting of the 
registration, the computer 10 starts processing of the registration (S6). In 
order to view a plurality of web pages at a time by operating the remote 
controller 30, for example, a plurality of program operations are registered 

10 for a single remote code RC. Now, the operation registration processing in 
step S6 will be described. 

In the operation registration processing in step S6, the computer 10 
registers the operation of the program in the registration table in 
association with the remote code RC. Referring to Fig. 4, the computer 10 

15 enters the kind of the operation of the program to be registered in 

association with the remote code RC in the registration table (S61). In 
step S61, the screen image shown in Fig. 5 is displayed at the display 13. 
Referring to Fig. 5, the user first selects the kind of operation of the 
program to be registered. The computer 10 registers the program 

20 operation in the registration table based on the kind selected in step S61 
(S62). 

If the user selects the "presetting operation", "P" is entered in the 
kind column in the registration table (S61). Referring to Fig. 6, the 
computer 10 asks the user to select the program to be registered (S621). 

25 The display 13 shows, as shown in Fig. 7, a plurality of programs having 

the already registered presetting operation tables. If the user selects "OS," 
the display 13 shows, as shown in Fig. 8, a plurality of operations 
registered in the presetting operation table. The user selects one of the 
operations (S622). When the user desires to register "shutting down," the 

30 "shutting down" button in Fig. 8 is selected. Since the operation ID 

corresponding to the "shutting down" in the presetting operation table is 
"2," "2" is entered in the operation ID column in the registration table 
(S623). If another program (such as a browser) is selected in Fig. 7, the 
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operations of the selected program are displayed at the screen image in Fig. 
8, and the user selects an operation desired to be registered. 

After the above operation, the computer 10 registers continuation 
information (S63), and records a message in the display content column in 
5 the registration table (S64). The registration of the continuation 

information will later be described. In step S64, the image as shown in Fig. 
9 is displayed at the display 13. When the user operates the remote 
controller 30 and desires to display a message at the display 13, the user 
inputs the desired message in the box 40 in Fig. 9. When the user inputs 

10 "shutting down" in the box 40, the message is entered in the display content 
column in the registration table. When the message is input to the box 40, 
the display column in the registration table shows "1." Note however that 
even after the message is input in the box 40, the user can change the 
display column to show "0." By the above operation registration 

15 processing, the registered content is entered in the registration table for 
example as information for the registration ID = 1. 

When the user selects "file operation" in step S61, "F" is entered in 
the kind column in the registration table. Referring to Fig. 10, the user 
identifies desired data resources. Specifically, the user inputs or selects 

20 the file path of a desired file or the address of a web page of interest (S624). 
When for example the user desires to record the operation of activating a 
browser and opening a desired web page for a remote code "2D 1234," the 
user inputs the address of the desired web page to the computer 10 using 
the input device 14. The addresses of a plurality of web pages may be 

25 displayed at the display 13, so that the user may select the address of the 
desired web page among the addresses. The file path or address input or 
selected is registered in the file name column in the registration table 
(S625). 

Now, the user selects an operation to be registered referring to the 
30 file operation table (S626). The display 13 displays a screen image similar 
to the image shown in Fig. 8, and the boxes show the operation recorded in 
the file operation table such as "open file" and "select application program." 
The user refers to the screen image, and selects the box of an operation 
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desired to be registered. The operation ID of the selected operation is 
registered in the registration table (S627). When for example the user 
selects "open file," the operation ID for "open file" in the file operation table 
is "1," and therefore "1" is entered in the operation ID column in the 
registration table. Note that once the address of the web page is recorded 
in the file name column, the operation ID registered in the operation ID 
column is 1, i.e., ID = 1 ("open file"), and a corresponding remote code RC is 
received, the computer 10 activates the browser and displays the web page. 
The subsequent operation is the same as that when the user selects the "OS 
operation" in step S61. The content registered by the above described 
operation registration is registered in the registration table for example as 
information for the registration ID = 2. 

If the user selects "shortcut key operation" in step S61, "W" is 
registered in the kind column in the registration table. Referring to Fig. 
11, the activated program whose operation is to be registered is selected or 
its identifier is input (S628). More specifically, a plurality of activated 
programs are displayed in a plurality of windows at the display 13, the user 
selects one of them and the class name of the window (program) is selected 
for the file name column in the registration table. Then, the user selects a 
key operation desired to be registered among the plurality of key operations 
in the shortcut key operation table (S629, S630). More specifically, the 
user operates keys in the keyboard as the input device 14, so that the 
computer 10 obtains the key operation (S629). All the key combinations 
(key operations) of the keyboard are registered in the shortcut key 
operation table. The computer 10 refers to the shortcut key operation 
table and specifies an operation ID from the obtained key operation (S630). 
When for example the user registers the operation of raising the sound 
volume by the activated music reproduction program, the user uses the 
keyboard serving as the input device 14 and carries out the key operation of 
raising the volume by the music reproducing program. When the volume 
raising key operation is carried out by the combination of the shift key and 
the key "Fl" on the keyboard, the user presses the shift key and the "Fl" 
key at a time, and the computer 10 obtains the key operation. The 
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computer 10 specifies an operation ID "577" corresponding to the key 
operation of pressing the shift key and the "Fl" key at a time in the 
shortcut key operation table. The computer 10 registers the class name 
input or selected in step S628 in the file name column in the registration 
5 table and the operation ID "577" in the operation ID column in the 
registration table (S631). 

Then, if the user desires to continue to raise the volume while a 
remote code RC is received, the user selects "1" for the continuation 
information (S63). More specifically, the user selects the button 50 in Fig. 

10 8. When the button 50 is selected, "1" is entered in the continuation 

information column in the registration table. Otherwise, "0" is entered in 
the continuation information column. The operation in step S64 is the 
same as that when the user selects the "presetting operation" in step S61. 
By the above operation registration processing, the content registered is 

15 recorded for example for registration ID = 3 in the registration table. 

When the operation registration processing in step S6 is carried out 
after multiple registration is selected in step S4, information for the 
registration ID = 4 is for example registered in the registration table. 
More specifically, a plurality of operations are registered in the operation 

20 column for the remote code "123582." 

Remote Control Operation Processing 

Referring to Fig. 12, when the sensor 22 in the receiver 20 receives 
an infrared ray signal IR (Sll), the decoder 21 transmits a decoded remote 
code RC to the computer 10 (S12). The computer 10 receives the remote 

25 code RC, and determines whether or not the remote code RC has been 

registered in the registration table (S13). As the result of determination, if 
the remote code RC has not been registered, the process returns to step Sll. 

When the received remote code RC is "ABCD99" in Table 1, the 
computer 10 determines that the received remote code RC is registered in 

30 the registration table under the registration ID = 3 (S13). The computer 
10 determines whether or not "1" is in the display column for the 
registration ID = 3 (S14). Since "1" is in the display column, the computer 
10 displays the message "raise volume" at the display 13 (S15). When "0" 
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is in the display column, no message is displayed. 

In step S15, after the message is displayed at the display 13, the 
computer 10 increases the volume of the music reproducing program (the 
identifier of the activated music program: Music PLAYER) recorded in the 
5 file name column. "1" is in the continuation information column for the 

registration ID = 3 and therefore the computer 10 continues to increase the 
volume as long as the sensor 22 receives the infrared ray signal IR (as long 
as the user continues to press the button of the remote controller 30). 

By the above operation, the remote control system 1 according to the 
10 embodiment can control the operation of program installed in the computer 
10 using the remote controller for TV or audio equipment. 

In addition, when there is a remote controller dedicated to the music 
reproduction program, the remote controller can also be used to operate 
another program. Therefore, the user can easily operate a plurality of 
15 programs installed in the computer 10 using the single remote controller. 

Furthermore, the remote control can be set to the channel buttons of 
the remote controller for TV so that a web page for the program guide of a 
channel can be viewed. As a result, when a channel button in the remote 
controller for TV is pressed, the TV screen image is displayed while the web 
20 page for the channel program guide can be viewed at the display 13 for the 
computer 10. 

Note that according to the embodiment, a remote control program is 
installed in the computer 10, but a remote control program may be installed 
in program-installable AV equipment rather than in the computer 10. 

25 According to the embodiment, the operation content of the program 

corresponding to the remote code RC is selected among the operation 
contents recorded in the presetting operation table, the file operation table, 
and the shortcut key operation table, but if the operation content of the 
mouse is registered in any of the operation tables, the operation of the 

30 mouse displayed at the display can be controlled as well using the remote 
controller. Different kinds of operations can be registered for a single 
remote code RC among when the user presses an operation button in the 
remote controller 30 only once, when the user presses it twice and when the 
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user continues to press the button at least for a prescribed time period. In 
short, the operation to be registered can be changed depending on how the 
operation button in the remote controller 30 is pressed. 

Furthermore, the computer 10 is provided with an infrared ray 
5 transmission device, so that home electronic equipment such as an air 
conditioner, TV and audio equipment can be controlled through the 
computer 10 using the remote controller. 

The embodiment of the invention is described simply by way of 
illustrating the present invention. Therefore, the invention is not limited 
10 to the embodiment described above and the embodiment may be modified 
as required without departing from the scope of the invention. 
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